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Abstract 

In the optimum sensitivity problem, one seeks 
to determine the values of derivatives of the 
optimal objective function and design variables 
with respect to those physical quantities which 
were kept constant as problem parameters during 
optimization. Examples of these sensitivity deriva- 
tives might include derivatives of cross-sectional 
area and structural mass with respect to allowable 
stress and derivatives of fuel consumed and wing 
aspect ratio with respect to aircraft range. De- 
rivation of the sensitivity equations that yield 
the sensitivity derivatives directly, which avoids 
the costly and inaccurate "perturb-and-reoptimize" 
approach, is discussed and solvability of the equa- 
tions is examined. The equations apply to optimum 
solutions obtained by direct search methods as well 
as those generated by procedures of the sequential 
unconstrained minimization technique (SUMT) class. 
Applications are discussed for the use of the sen- 
sitivity derivatives in extrapolation of the optimal 
objective function and design variable values for 
incremented parameters, optimization with multiple 
objectives, and decomposition of large optimization 
problems. Several aspects of these applications and 
verification of the sensitivity equation are pre- 
sented through numerical examples. 


Nomenclature 


n number of design variables in optimization 
problem 

P penalty term in penalty function <p, and force 
P|^ k-th parameter; in differentiation with respect 
to P|^, k is omitted 

r draw-down factor in SUMT 
W weight 

X,x^ respectively: vector of design variables, and 

i-th design variable 

c constraint violation tolerance (typically a 

small number, e.g., 0.025) 

X vector of m Lagrange multi piers 
A. j-th multiplier corresponding to j-th active 
^ constraint 
(p penalty function 

Subscripts and Superscripts : 

a allowable value 
e extrapolated value 

h number of objectives in a multiobjective 
optimization 

i i-th design variable, i-th weighting factor 

j j-th constraint, j-th weighting factor 

k k-th parameter 

1 lower bound 

0 initial value in extrapolation 

p prescribed quantity 

q refers to q-th design variable 

u upper bound 

Overbar denotes quantities at optimum. 

Differential notation: 

E 3f/3x^.; 3^f/3x. 3x^ 

^'= 8f/ap assuming constant x^-values 

s^f/ax^. 3p 


a weighting factor; allowable value when in 

subscript 

A cross-section area 

b behavior variable 

C a convergence tolerance governing termination 
of optimization 

f function in general mathematical sense 

F objective function 

g vector of m constraints 

gj j-th constraint, assumed to be active unless 
noted otherwise; constraint is violated when 
9j > 0 

m number of constraints active at constrained 

minimum 


in this notation: 
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n X m matrix 
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length n 
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i, row vector 
1 of length m 


Introduction 

Nonlinear mathematical programin^j has become 
well established as a tool for defining optimal 
engineering designs as local constrained minima. 

A typical constrained minimization problem entails 
a group of physical quantities which are used as 
design variables and a group of constant quantities 
termed parameters of the problem. It is of obvious 
interest to know, when the optimization is com- 
pleted, the sensitivity of the constrained minimum 
to the parameters of the problem. Mathematically, 
this requires the determination of the partial 
derivatives of the objective function and design 
variables with respect to the parameters of interest. 
These derivatives are referred to as sensitivity 
derivatives. For example, in structural optimiza- 
tion, it would be useful to determine the effect on 
optimal structural mass and cross-sectional dimen- 
sions of changes in allowable stress or displace- 
ments. In an aircraft configuration optimization 
the information of interest would be the sensitivity 
of optimal block fuel consumption and wing aspect 
ratio and area, to variations of required range and 
payload. 

Generation of sensitivity derivatives by finite 
difference approximations requires reoptimization of 
the problem with incremented values of the param- 
eters. This is a costly procedure burdened with 
the difficulty of assessing numerical errors. A 
preferable approach is to obtain the sensitivity 
derivatives directly from an appropriate set of 
equations. This approach, known as optimum sensi- 
tivity analysis, became well-established as a 
routine tool in linear programing.! * in contrast, 
sensitivity analysis in nonlinear mathematical pro- 
graming is still at an early stage of development, 
and its incorporation into engineering practice is 
as yet to be accomplished. The relatively limited 
literature available on the subject, primarily in 
the discipline of operations research, is well 
represented by Refs. 2, 3, 4, and 5. Specifically, 
Ref. 2 gives a solution to the problem of finding 
the increments of the optimum objective function and 
variables caused by simultaneous small changes of 
the problem parameters, and contains references 
to other relevant early works. Reference 3 develops 
a solution for sensitivity in the context of a 
sequential unconstrained minimization technique 
(SUMT) and a particular form of a penalty function. 
Some computational experience with that solution 
including an application in resource management is 
reported in Ref. 4. The authors are aware of no 
reported research on optimum sensitivity analysis 
applied to optimization of structures and other 
engineering systems with the exception of a simple 
torsion bar example in Ref. 5. 

The objectives of this paper are to show how 
the equations capable of yielding the sensitivity 
derivatives (the sensitivity equations) can be 
obtained for a constrained optimum regardless of 
the type of optimization algorithm that was used to 


arrive at the optimum point; to review the solv- 
ability of the sensitivity equations; and to report 
on applications in structural optimization. 

Lagrange multiplier equations and the extremum 
conditions of a penalty function in general, and 
the interior and exterior forms of that function 
in particular, are included as alternative bases 
for derivation of the sensitivity equations. 
Numerical examples verify the algorithms and illus- 
trate evaluation of the sensitivities of optimal 
structures to parameters such as load, allowable 
stress and overall geometrical shape and the 
influence of individual conflicting objectives 
(e.g., weight and cost) in multiobjective optimiza- 
tion. An additional application of the sensitivity 
analysis, to provide a basis for a formal decom- 
position in hierarchical optimization problems, is 
also discussed. 


Sensitivity Equations 

There are at least two ways of deriving equa- 
tions for the unknown sensitivities. One way is 
to start from the Lagrange multiplier equations of 
the constrained minimum; the other way begins with 
the extremum conditions of a penalty function. In 
either case the same general functional relation- 
ships are recognized. Namely, the objective 
function: 


F(Xj,X 2 , p^,P 2 ,...P|^) (la) 

and constraints active at the optimum point 


gj(Xi,X2, Pj.D^, ...p,.) (lb) 


and implicitly 


x^-(Pl.P2.---Pk) (Ic) 

There is no need to distinguish among the equality 
and inequality constraints in the original formula- 
tion of the optimization problem being analyzed for 
sensitivity, because all constraints active at the 
constrained optimum point may be regarded as 
equality constraints. 

Sensitivity Equations Derived from the Lagrange 
Multiplier Equations 

The familiar Lagrange multiplier equations 
satisfied at a constrained minimum are: 


= 0. i = n 

(2a) 

= 0, j = 1 -> m 

(2b) 


The equations may be differentiated with respect 
to the parameter p^ using the chain-differentia- 
tion rule for composite functions along with the 
functional relationships in Eq. (1). The result 
of the differentiation is: 


2 



n 



+ g^’^x'= 0, i = 1 - n (3a) 

n 

o'. + 2 j = l^m (3b) 

i=l 


Equation (3) can be converted to a uniform matrix 
notation by collecting terms and using an auxiliary 
matrix Z: 


[F + Z] 

[g]~ 




' {F') + [g'HA} ' 

nxn 

nxm 



+ , 

nxi nxm mxi 

[g]^ 

[0] 


X' 


{g'} 

mxn 

mxm 


- 


mxi 


(n+m) X (n+m) (n+m) x i (n+m) x i 


multipliers are available as a by-product of^the 
optimization solution. Derivative vectors g- 
must be linearly independent in order for the'^ 
matrix of coefficients in Eq. (4) to be nonsingular. 
A Gram matrix test»6 in addition to physical in- 
sight, may be used to identify redundant con- 
straints to be eliminated. No ill conditioning 
difficulties were observed when solving Eq. (4) 
for test problems using a standard Gaussian elimina- 
tion solution al^gorithm. A particular case of 
m = n causes X' in Eq. (4) to decouple from X' 
(see discussion of Case 4). 

Case 2: Multipliers Xj Not Available From 

the Optimum Solution . The Lagrange multipliers Xi 
must be known in order to construct the matrix of 
coefficients (they enter matrix Z and the vector 
of free terms in Eq. (4)). If the optimum being 
analyzed for sensitivity is obtained by a method 
that does not yield the X-values as part of the 
solution, these values have to be computed as part 
of the input to Eq. (4) (for an exception see 
Eq. (8) and the discussion of Case 4). One well- 
known relationship^ that may be used for computing 
the X values is 



where ^the matrix g contains the constraints active 
at the optimum. It is important again that only 
the linearly independent constraints among the 
active set be included in Eq. (6) as mentioned in 
the discussion of Case 1. 


where the dimensions of vectors and matrices are 
inscribed for clarity, and where Z is defined as 
a square, n x n, matrix whose i,q-element is 


m ,1 

7(1. q) = y» 


‘J 


(4b) 


Equation (4), whose terms are evaluated at the con- 
strained minimum point, constitute a set of n+m 
simultaneous linear algebraical equations for 
unknown derivatives of the optimum solution x' 

(n elements) and X' (m elements), the latter 
being auxiliary quantities. 

Once the sensitivity derivatives are ob- 
tained, the sensitivity derivative of the objective 
function is determined as total derivative of 
the composite function F: 

dF/dp = F' + ^ xl (5J 

T * 


Case 3: Linearity of Constraints or Objective 

Function . The linearity of constraints at the 
optimum eliminates the matrix Z, while the linearity 
of the objective function renders F = 0. However, 
if the linearity of the constraints and objective 
function do not occur simultaneously, the term F + Z 
does not vanish and the unknowns V and x' remain 
coupled in Eq. (4). 

This case also includes the constrained minima 
in which some of the active constraints are side 
constraints. For the purposes of sensitivity ana- 
lysis, such constraints should be reformulated as 
inequality constraints 


9j = 1 - 1 0 or 

9j = x/x.^ - 1 < 0 


(7) 


for lower and upper bounds, respectively. This 
formulation leads to derivatives with respect to 
Xl, Xj] and Xj^j and, also permits sensitivity 
analysis with respect to the side constraint param- 
eters such as Xj] and Xju. 


Solution of the Sensitivity Equations 

The ways to obtain a solution for X* (and 
X') from Eq. (4) may be categorized in a number of 
cases. 

Case X: All Submatrices in Eg. (4) Exist . 

This basic case corresponds to a constrained minimum 
defined by a nonlinear objective function and non- 
linear constraint functions. The Lagrange 


Case 4: Linear Constraints and Linear Objec- 

tive Tun^tion^ Under this condition T~=~~0 and. 
Z = 0, hence the term F + Z vanishes and the V 
and X' vectors decouple in Eq. (4) so that: 

+ {g'} = {()} (8) 

mxn nxi mxi 
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an equation that does not contain the Lagrange 
multipliers A. The solvability of Eq. (8) depends 
on the dimensions m and n and requires con- 
sideration of the following subcases that are 
likely to occur in practice. 

Subcase 1 : The g^ is a square matrix, 
m = n, and there are no null rows and columns. 
Consequently, Eq. (8) is determined so that a 
unique solution can be obtained for X'. Typically, 
this subcase occurs when a nonlinear mathematical 
programing problem is solved by a sequence of steps, 
each step consisting of finding a constrained mini- 
mum of the problem that is locally linearized and 
subjected to move limits expressed in form of 
Eq. (7). Such a minimum falls on a full vertex of 
the linearized feasible domain, hence m = n. 

Subcase 2: The g^ is a rectangular matrix 

with m < n rendering Eq. (3) underdetermined. 
Despite this, the sensitivity analysis can still be 
pursued by seeking m values of xj such that 
dF/dp is maximized. Mathematically, this calls 
for augmenting Eq. (8) with an equation for dF/dp 
{Eq, (5)), and solving the resulting linear program- 
ing problem that yields m values of x' ^ 0 and 
(n - m) values of x' = 0. The corresponding 
minimization of dF/dp can also be carried out, 
thus estimating the range of values of the objective 
function sensitivity. 

This subcase may arise in a nonlinear problem 
whose constrained minimum occurs not at a full 
vertex of the feasible domain (where it would be 
m = n), but is defined, at least in part, by tan- 
gency of the curved constaint boundary hypersurfaces 
to a constant objective function hypersurface 
(e.g., three-bar truss discussed later in this 
report). In many cases, the hypersurface curvatures 
represented by the second derivatives with respect 
to the design variables may not be available 
among the results of the optimization procedure, 
and the cost of computing them may be prohibitve. 
Therefore, they may have to be omitted (set to zero) 
in the input to the optimum sensitivity analysis. 
Omitting the unavailable second derivatives in 
effect replaces the hypersurfaces of the objective 
function and constraints with hyperplanes inter- 
secting at the constrained minimum point but not 
forming a full vertex there. Consequently, that^ 
point coordinate definition in the design space is 
lost and Eq. (8) becomes undetermined. 

Sensitivity Equations Derived from Extremum 
Conditions of a Penalty Function 

In a broad class of methods known as 
Sequential Unconstrained Minimization Techniques 
(SUMT), the objective function is augmented by a 
penalty term containing the constraints and an 
approximation to the constrained minimum is deter- 
mined asymptotically by generating a series of 
unconstrained minima of a penalty function.^*' 
Sensitivity equations analogous to Eq. (4) may 
be obtained for a SUMT- determined constrained 
minimum by differentiating the extremum conditions 
of a penalty function with respect to a parameter. 

There are many formulations of the penalty 
functions currently in use, for example; interior, 
exterior^ and a quadratic extended^ penalty function 
formulations. Therefore, a penalty function in its 
most general form is expressed as 


(|) = F + rP (9) 

The penalty term P is a function of the con- 
straints: 

•P(gj), j = 1 - m ( 10 ) 

The extremum conditions for are: 
m 

^(i) = f(i) + r 2 ^ = 0> ■* = 1 ^ " 

j=l ^ (11) 

Differentiation of Eq. (11) with respect to param- 
eter pk yields 



Equation (l2) represents a set of n simultaneous 
linear equations for n unknown values x^. 

For a specific case of an interior penalty 
function in a frequently used form 

m 

P = -S 

j=l 

Eq. (11) becomes 

( 'm 

2; g 

and Eq. (12) yields 

[M]{X'} + {R} = 0 (15) 

nxn nxi nxi 
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where: 


m ^ ^ T n ^ 

j=l j=l 


», =F."l-2rSg-35j,<".rSg:V<> 
j=i 0=1 


At this point one may be tempted to take advantage 
of the fact that « gi^ for active constraints, 
which are very small by definition, and to neglect 
terms with gi^ (second derivatives would become 
eliminated fr6m the calculations) in Eq. (15) -a 
simplification that has been introduced into 
optimization practice by Ref. 9. However, such a 
simplification cannot be made in this case because 
it renders Eq. (15) singular. 

Turning now to an exterior penalty function 
whose penalty term is: 


penalty function). If the location is slightly 
off into the unfeasible region (a typical result of 
the use of an exterior penalty function) the cor- 
responding extremum condition equations for an 
exterior penalty function can be used to calculate 
r. Any equation arbitrarily chosen among n equa- 
tions involved may be used to calculate the single 
unknown r, but the accuracy of this calculation 
will obviously benefit from choosing an r that 
minimizes the sum of the squares of residuals of 
Eq. (11), thus solving these equations in a least 
squares sense. The algebraic structure of the 
sensitivity equations for the penalty function 
makes their solution.,independent of the constant r 
in cases for which F(i»q) e 0 and f‘(i) e 0. 

These cases include, for example, sensitivity of 
minimum structural mass with respect to parameters 
other than the specific mass and overall geometrical 
dimensions. 

In both Eqs. (4) and (15), only the right-hand 
side vector contains the mixed derivatives (•') 
that depend on the choice of parameter p with 
respect to which the sensivity analysis is to be car- 
ried out. This property obviously reduces the 
amount of numerical labor required in problems with 
many parameters. 


j=l 


«9j»^ 


<g.> 


g.. if g. > 0 
0. , if gj < 0 


( 16 ) 


one obtains Eq. (12) in the form 

[H] {X'} + (R) = 0 (17) 

nxn nxi nxi 

where 

+ 2 r 2 

j=l ' ' 

R, .p(') 

and all constraint functions are in the <gj> 
form defined by Eq, (16). 


Cross-Applications of Eqs. (4) and (12) 

Although the origin of Eq. (4) seems to suggest 
that it is appropriate for a sensitivity analysis 
of constrained minima obtained by one of the direct 
minimization methods (i.e., usable-feasible direc- 
tions technique) and, by the same token, Eq. (12) 
seems to apply naturally in sensitivity analysis of 
constrained minima found by an SUMT approach, 
these equations can be cross-applied. In such 
cross-applications, Eq. (6) can be used to determine 
the X-values and Eq. (11) to compute the r-value, 
so that one can apply Eq. (4) (and the corresponding 
solution subcase equations) to analyze the sensi- 
tivity of the SUMT-obtained constrained minima, and, 
conversely, Eq. (12) can be used when a constrained 
minimum is determined by a direct search algorithm. 


Potential Applications 

The primary application that inspired the method 
discussed herein is the enhancemenc of the results 
of optimization with sensitivity data, thus increas- 
ing, at a relatively small additional cost, the 
information about the object being optimized, 
including a possibility of extrapolation with 
respect to incremented parameters. However, the 
method appears capable of additional applications 
which are described in this section. 


Other forms of penalty functions can be treated 
in the same manner (e.g.. Ref. 4). 

Numerical values of the objective and constraint 
functions, their derivatives, and, in a general 
case, the value of r are necessary for generating 
sensitivity equations such as Eq. (15). The value 
of r may not be available for the particular case 
of a constrained minimum being analyzed for sensi- 
tivity. However, it can be computed for the given 
set of constrained minimum point coordinates from 
Eq. (11) if that point's location is slightly off 
the constraint boundary in the feasible region (a 
typical outcome of a SUMT using an interior 


Extrapolation 

The sensitivity derivatives provide an estimate 
of the change in the objective function and design 
variables corresponding to a small change of a 
parameter. Using the first two terms of the Taylor 
series expanded about the optimum design point x^: 

Fg = Fjj + (dF/dp) Ap (18a) 
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1 = 1 n 


" = (Sj^old ^ (9j 


"ei = "oi 


+ X- Ap; 


(Iflb) 


Alternatively, for F computed as 
at optimum: 


F 


e 


f (^ei) 


(18c) 


which suggests recomputing F using the Xgj 
estimates obtained from Eq. (18b). 

Optimization with Multiple Objectives 

Sensitivity analysis may be used to evaluate 
the influence of each of the multiple objectives 
on a constrained minimum. In a multiple objective 
optimization one may use a composite objective 
function in the form of a weighted sum of the single 
objectives: 


F ~ ^1^1 ^ ^2^2 


a.F. . 


^h'^h 


(19) 


where the weighting factors a^ represent the 
relative importance of the individual objectives 


Since each weighting factor a-j is a problem 
parameter, the sensivities of the optimum with 
respect to the aj factors can be obtained to 
determine the influence these factors have on the 
optimum and the trends associated with changes to 
the aj values. It is conceivable that in well 
behaved problems it may be possible to use the 
derivatives with respect to aj for extrapolation 
of F and Xj values to estimate their magnitudes 
for aj = 1, and aj = 0, for j f i. This, in 
effect, would provide estimates of single objective 
optimizations for each of the "h" objectives Fj, 
at a computational cost not much larger than the 
cost of a single optimization. 

Ac t i va t i on or Deactivation of a Constraint 


The X' sensitivity derivatives generated in 
the course of the sensitivity analysis may be used 
to evaluate the increment in parameter p that will 
render an active constraint inactive. Considering 
the active constraint gj, and the corresponding 
Xj value, a simple extrapolation of Xj to zero: 


"ej = ^ ° (20a) 

yields an estimate 

Ap = - X^j/Xj (20b) 

for the increment Ap of parameter p sufficient 
to remove the constraint gj from the active con- 
straint set. Analogously, one may estimate an 
increment Ap needed for an inactive constraint, 
whose value gj is less than - e at the 
constrained optimum, to become active: 


(g-) 

^new 

(21) 

where the x\ values are available from the sensi- 
tivity analysis and the values of gj and g[^) 

would have to be computed additionally for the 
previously inactive constraint gj. 

Decomposition of a Large Optimization Problem into 
Several Sut^pyiem? 

Another application is a decomposition of 
large multivariable optimization problems into a 
number of smaller subproblems. Suppose that the 
vector (X) of n design variables in an optimiza- 
tion problem is partitioned into Xa and Xb parts 
of n/\ and ns respective lengths, and that an 
optimization is performed with nA variables, 
while holding elements of (Xg) fixed as parameters 
of the problem. Applying the optimum sensitivity 
analysis, the partial derivatives of the objective 
function and elements of (Xa) with respect to 
elements of (Xb) can be obtained. These derivatives, 
used in a first order Taylor series, permit expres- 
sion of the objective function and each element of 
(Xa) as approximate linear functions of (Xb) thus 
eliminating (Xa) from the problem in the vicinity 
of the design point where the derivatives were 
evaluated. This capability to eliminate a group 
of variables may be used as means for formal 
decomposition of a large optimization problem. To 
be amenable for such decomposition, the problem 
should have a hierarchical structure of variables. 
This means that for each subsystem at level 
"1 + 1" a vector (Xa) can be identified as con- 
taining the subsystem "local" variables and Ub) 
can be recognized as being composed of the variables 
that a subsystem of a higher level i imposes on 
the subsystem at the lower level "i + 1". Carried 
out systematically to the system level, that is to 
the highest level of i = 1, this decomposition 
would eliminate all subsystem local variables 
replacing them with their linear approximate 
relationships to the variables of the highest level. 

At the present stage of development, applica- 
tions beyond the straightforward sensitivity 
evaluation and extrapolation (see the numerical 
examples) require further numerical experimentation 
to assess their usefulness. 


Numerical Examples 

This section contains numerical examples which 
demonstrate the sensitivity analysis in the context 
of structural optimization, verify correctness 
of the analysis, and provide a measure of usefulness 
of sensitivity derivatives in estimating the effect 
of problem parameters on the optimal objective 
function and design variables. The examples in- 
clude a tubular column and a three-bar-truss for 
which closed form solutions are obtained, a ten-bar 
truss that requires use of a finite element ana- 
lysis, and a thin-walled beam characterized by 
strongly nonlinear constraints for local buckling. 
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All the numerical examples are defined by 
Fig. ! and detailed data* provided in the Appendix. 

Verification of the Sensitivity Equations 

A tubular thin-walled column and a three-bar 
truss, 10 shown in Fig. la and lb, offer a possibil- 
ity to verify the sensitivity analysis in a closed 
form. Each of these cases poses a two-design 
variable problem for which the closed form expres- 
sions for the objective function and constraints 
are given in the Appendix. 

Tubular Column . Closed form expressions 
(Eq. (A2)) define the constrained minimum formed 
by vertices of constraints 1 and 3 described in 
the Appendix. Differentiation of these expressions 
with respect to parameter P yields a set of 
sensitivity derivatives. Another set of the 
sensitivity derivatives is obtained from Eq. (4), 
whose terms are derived analytically from the ob- 
jective and constraint functions given in the 
Appendix. By the way of verification of Eq. (4), 
the two sets of the sensitivity derivatives are 
shown to be in an exact agreement in Table lA. 

Three-Bar Truss . For the three-bar truss, the 
constrained minimum formulas (Eq. (A5)) describe 
the minimum at the point where the objective func- 
tion contour (straight line) is tangent to con- 
straint 11 (Eq. (A4)) as shown in Ref. 10, 

Figs. 1-7. The sensitivity derivatives 
displayed in Table IB (Key 1) are calculated from 
Eq. (4) whose terms are derived analytically 
from Eqs. (A3) and (A4). For verification, these 
derivatives agree exactly with the results of direct 
differentiation (Key 2). Derivatives with respect 
to P were derived from Eq. (A5). Shown also in 
Table IB is the good agreement between results 
obtained from Eq. (4) (Key 1) and Eq. (15) (Key 3). 

The upper and lower estimates of dF/dp 
(Key 4 and 5), obtained from the linearized Case 4/ 
Subcase 2 (see Eq. (8)) are both very close to the 
exact value despite that the corresponding design 
variable derivatives are not. Moreover, the inter- 
val between these estimates is very narrow and it 
does contain the exact value of dF/dp. However, 
it was not attempted within this study to prove 
that this is a general property of the solution of 
Case 4 rather than a fortuitous result. 

Results for a truss configuration with a =60° 
are given in Table 1C. Since, when closed form 
solutions are sought for derivatives with respect 
to a, expressions corresponding to Eq. (A5) are 
algebraically complex, their differentiation (Key 6) 
is additionally verified by a finite difference 
approximation . 

The linearity of the truss constraints and 
objective function with respect to load P and 
ratio of the load to the allowable stress (P/og) 
provides an additional verification of the cor- 
responding sensitivity derivatives. Because of 


*The three-bar and ten-bar truss are intended to 
be examined in context of the standard reference 
examples that were published using t'.c* U. S. 
Customary Units. Therefore,, they ari-- presented in 
the same units for consistency, 'jhili the SI 
units are used in the other examples. 


that linearity, the relative changes of cross- 
sectional areas are equal to the relative change of 
the load and could have been predicted by simple 
insight. The same is not true, however, for the 
tubular column whose nonlinear relationship between 
the design variables and the load are introduced 
by the buckling constraints, and for the parameter 
a in the truss where the nonlinearity is of a 
geometrical origin. It is in such nonlinear cases 
that the sensitivity analysis method discussed 
herein finds its usefulness. 

Extrapolation of the Optimal Solution 

Examples of extrapolation defined by Eqs. (18a), 
(18b), and (18c) are given for the three-bar truss, 
a ten-bar truss and a thin-vjalled beam. 

A Three-Bar Truss Example . An optimum solu- 
tion was considered as a function of the angle a 
(Fig. lb). Results collected in Table 2 for two 
truss configurations, with a = 45° and 60°, show: 

1. In rows 1 and 6: the optimal solution 

obtained by a usable-feasible directions 
method coupled with a finite element 
program. The use of numerical methods for 
optimization and analysis accounts for the 
small differences between these results 
and the exact solution given in Table IB 
and in Ref. 10, for a = 45®. 

2. In rows 2 to 5 and 7: extrapolated 

values are compared with the results of 
reoptimizations from the initial point 
(Ai = A2 = 1) and from the optimum 
point (row l). Extrapolation is carried 
out using the sensitivity derivatives from 
Table 1, and formulas (18a) and (18b). 

In one case, in row 7, a result from 
Eq. (18c) is also given. 

The extrapolation results are very good for 
small increments of 5 percent; they gradually 
deteriorate for larger increments, significantly 
so for the smaller of the two design variables (A2). 
However, they remain very good for the larger 
variable (A^) and excellent for the objective 
function (mass) throughout the comparison range, 
even for 45°/60° change of a in both directions. 
One of the results, given in row 7, shows the 
extrapolation of the objective function by Eq. (18c) 
as being significantly better than the one obtained 
from Eq. (18a). 

The number of optimization iterations in re- 
optimization from the optimum solution point varied 
from a little less than, to about one half the 
number of iterations needed for reoptimization 
from the initial point (Ai = A2 = 1). This under- 
scores the reduction of the computing cost realized 
by substituting the sensitivity analysis for re- 
optimization with incremented parameters. 

A Ten-Bar Truss Example . The truss shown in 
Fig. Ic often” used in the optimization literature 
(e.g.. Ref. 11) as one of the standard reference 
examples for algorithm testing, is chosen to illus- 
trate a case too large to be handled by a closed 
form solution. Consequently, a stiffness-based, 
finite element method, augmented with an analytical 
technique (e.g.. Ref. 7, 11; or 12) to generate 
first and second derivatives of di spin cements and 
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stresses with respect to the design variables, 
was used as the analysis program. This program was 
coupled with a general purpose optimization pro- 
graml3 to obtain an optimum solution. The optimum 
sensitivity algorithm based on Eq. (4) was imple- 
mented as a general purpose program and executed 
as a postprocessor to the optimization procedure. 

The objective function was the material weight, 
and the ten cross-sectional areas (numbered in 
Fig. Ic) were design variables. Constraints were 
imposed as minimum limits on the variable values, 
and as an allowable stress (see Appendix). 

Optimum solution and sensitivity derivatives 
with respect to the truss depth H are collected 
in Table 3. The nonzero derivatives are negative, 
because the increase of H decreases the forces 
in the horizontal and diagonal rods. Considering 
variations of H, Table 4 presents comparisons of 
reoptimization results for increments of H versus 
extrapolation results obtained by Eqs. (18a) and 
(18b) using sensitivity derivatives from Table 3. 

The comparison shows that the relative errors of 
extrapolation do not exceed 2.5 percent for the 
design variables and 1.3 percent for the objective 
function for 20 percent increment of_ H._ The 
comparison is presented graphically in Fig. 2 for 
the objective function and one typical variable 
(Ai). The graph shows that the extrapolation 
practically coincides with the reoptimization for 
up to 10 percent change of H. For a 20 percent 
change of H, extrapolation overestimates the 
decrements of weight and typical variable by about 
18 percent and 12 percent, respectively. 

For this structure, it would be difficult to 
predict by physical insight alone how the objective 
function would change with the increase of H, 
because the decreases of cross-sections are counter- 
acted by the increases of lengths in the diagonal 
and vertical rods. 

A Thin-Walled Box Beam Example . The beam 
shown in Fig. Id provides an example with a high 
degree of nonlinearity because of the constraints 
which include local buckling and the equality 
constraints imposed on the cross-sectional area 
and moment of inertia. In this problem the values 
of variables B, H, T^, T2, and T3 are sought 
that make A and I equal to prescribed values 
An and Ip while minimizing the objective 
function F = n, where 


j 


(9j- 9j > ° 

(0.00, if 9j 1 0 


(22b) 


and the constraints gj are the stress constraints 
(see Appendix, Eqs. (A17) and (Al8)). The quantity 
provides a single measure of unsatisfaction of 
the constraints, and because of the power factor 
in Eq. (22a), it is continuous up to its first 
derivatives with respect to the design variables. 


if the constraints are continuous. This continuity 
is required for the optimizer (Ref. 13) used in the 
study. Thus, the optimization problem is 


min F, subject to 


A = Ap, I = Ip, F = defined by 
Eq. (22), and 

gj < 0 

where inequality constraints gi are the minimum 
gage and other geometrical constraints (see Appendix, 
Eqs. (All), (A12) and (A13)). This somewhat unusual 
formulation of a structural optimization problem has 
a meaning of proportioning the detailed dimensions 
of a cross-section to achieve a least violation of 
the constraints, while conforming to the prescribed 
cross-section stiffness properties in tension (Ap) 
and bending (Ip), and is motivated by its use in a 
multilevel decomposition described in the section on 
"Potential Results." In that decomposition, the 
Ap and Ip values are to be the system level 
variables imposed on a beam treated as a subsystem 
governed by local variables B, H, Ti, T2, T3. 

As explained in the Appendix, the variables B 
and T2 are eliminated from the problem by solving 
the equality constraint equations A = An and 
I = Ip, so that only the variables H, Ti and T3 
are left as free variables. Similarly, equilibrium 
equations are used to express the right-end forces 
in terms of the left-end, statically independent 
forces. The stress and geometry constraints are 
expressed as functions of the end forces and design 
variables as shown in the Appendix. Because of the 
algebraic complexities of these functions, all the 
derivative terms in Eq. (4) are computed by finite 
differences. 

The optimum solution and the sensitivity 
derivatives of the independent local variables and 
the objective function with respect to the bending 
moment N3 and the moment of inertia Ip are 
displayed in Table 5. The reoptimization reference 
results for variations of N3 and Ip and the 
corresponding extrapolation results are collected 
in Table 6. The table shows the extrapolation 
estimates to be quite good throughout the parameter 
variation range with respect to absolute values 
of the objective function and design variables as 
well as their increments. A typical sample of the 
extrapolation and reoptimization results for the 
box beam is plotted in Fig. 3 against the variations 
of the parameter Ip. The graph shows the extrap- 
olation's capability to account for practically the 
entire change of the objective function F and 
the design variable H (the beam depth) correspond- 
ing to a parameter increment of up to 20 percent. 

The objective function was extrapolated using 
Eqs. (18a) and (18c) (F* and F**, respectively in 
Table 6) with the latter giving much better esti- 
mates {this trend was already observed in Table 2, 
row 7). 

The relatively good accuracy of the extrapola- 
tion results for the beam problem suggests its 
potential usefulness in the previously described 
concept of a multilevel decomposition. 
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Optimization with Conflicting Objectives 

The three-bar truss example is used to test 
the capability of the sensitivity analysis to 
determine the influences of several, possibly 
conflicting, objectives. The three-bar truss 
(Fig. lb) is used again as an example. The truss 
is modified so that the rods corresponding to 
cross-section Ai are assumed to be made of steel 
oa = 36667. Ib/in2, p = 0.282 Ib/in^, and unit 
volume cost c = 5. $/lb; the center rod (A2) 
is assumed to be made of titanium of Oa = 40000., 
p = 0.160 and c = 11. Minimization of the 
mass (F^) and cost (F 2 ) objectives is considered, 
with the realization that the two objectives will 
conflict because titanium is lighter but also 
more costly than steel. 

First, an optimization is carried out with a 
composite objective function F = ai Fi + a 2 ^F 2 
from initial point Ai = A 2 = 1. , and the weighting 
factors ai = a2 = 1. that reflect an approxi- 
mately even "Importance" subjectively assigned 
to the two objectives (the constant 3 equalizes 
numerical magnitudes of the two terms in F at 
the initial point). The results of the optimiza- 
tion are given in Table 7, row 1. The reader may 
find it interesting to compare these results with 
the optimum solution point given for a single mate- 
rial truss in Table IB. Next, sensitivity 
derivatives with respect to weighting ("importance") 
factors are obtained (Table 7, rows 2 and 3), treat- 
ing the factors as parameters of the problem, to 
determine the trends that would be followed should 
the relative importance of the two objectives 
change. These trends are extrapolated to the 
extremes of mass-only and cost-only in rows 4 and 5, 
and are verified by the results of full optimiza- 
tions for each objective separately, starting from 
the initial point. The objective function extrap- 
olation results shown are obtained by Eq. (18c) 
which, in this case, provided again a better accu- 
racy than Eq. (I8a). Comparison of rows 4 and 5 
with row 1 shows that: 

( 1 ) Single objective optimization yields an 
objective value reduced relative to the 
value of the same objective obtained 
from multiobjective optimization (an 
expected result). In this case the 
reductions are small, but significant, 

2.52 percent for the mass and 1.95 per- 
cent for the cost. 

(2) The extrapolation underpredicts the mass 
reduction by about 9 percent and over- 
predicts the cost reduction by about 

36 percent. 

The verification shows the previously observed 
tendency for good prediction of the larger of the 
design variables and even better prediction for the 
objective function. Remarkably, the disappearance 
of the expensive titanium rod in the cost-only 
optimization is predicted very well by the extrap- 
olation. It appears that the approach has the 
potential of providing useful estimates of the 
results of many single objective optimizations by 
extrapolating from the results obtained by executing 
only one optimization with a composite objective 
function. 


Sensitivity Analysis Accuracy as a Function of the 
Optimum Solution Degree of Convergence 

The relative error of extrapolation obviously 
depends on the accuracy of the sensitivity deriva- 
tives which, in turn, are influenced by the degree 
of convergence of the optimum solution. Although, 
theoretically, solution convergence is rigorously 
prescribed by the Kuhn-Tucker conditions, in prac- 
tice the optimization procedures usually terminate 
by less rigorous, "practical," criteria. For 
example, the optimizer13 used in this study may 
stop when all the constraints are satisfied and 
when the last n iterations (n was assumed 5) 
produced relative differences between two 
consecutive objective functions smaller than a 
tolerance C. To be able to use the optimum 
sensitivity analysis with confidence, one needs to 
know how strongly the sensitivity derivatives depend 
on the convergence controls represented by, for 
example, the tolerance C. 

Results that shed some light on that dependence 
are shown in Tables 8, 9, 10 for the three-bar and 
ten-bar trusses and for the beam. The results show 
consistently the influence of C to be rather weak, 
especially for the objective function derivatives. 
The relatively large error of the derivative of Ti 
(3 Tx/ 3N3) in Table 10 appears to have little 
significance because this particular derivative 
value is practically a numerical zero as shown in 
Table 5. 

Since the tolerance C influences rather 
strongly the number of iterations (indicated in the 
tables), it appears that one may save some computa- 
tional cost and obtain sufficiently accurate sensi- 
tivity information by not pursuing the optimization 
procedure too far beyond the aforementioned thres- 
hold on its convergence path. 

Summary of the Numerical Examples 

Results of the examples verify the numerical 
solutions of the sensitivity Eqs. (4) and (15) by 
analytical solutions for the simple cases of a 
tubular column and a three-bar truss. The three-bar 
truss results suggest also that in some cases a 
linearized, inexpensive analysis may provide very 
good estimates for the objective function sensi- 
tivity derivative dF/dp. Additional verification 
of the sensitivity equations is seen in the agree- 
ment of the extrapolation results and the reoptimi- 
zation results for small variations of the param- 
eters in the ten-bar truss and the thin-walled beam. 

For all cases tested, the extrapolation based 
on the sensitivity derivatives shows the ability 
to predict the reoptimization results with a rela- 
tive error of the order of a few percent for a 
parameter increment range order of 20 percent, and 
the relative error appears to be a rather weak 
function of the degree of convergence of the 
optimum solution within practical convergence 
limits. For smaller increments, below 10 percent, 
the relative error of extrapolation is small enough 
for the accuracy needed in most engineering calcu- 
lations. This is apparently due to the fact 
(apparent in Figs. 2 and 3) that although the 
relative variations of the objective and constraint 
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functions may be of the same order as the relative 
increments of the parameters that cause them, they 
are, at least for the cases tested, nearly linear 
functions of these parameters in the vicinity of the 
optimum despite the nonlinearity of the optimiza- 
tion problems themselves. 

The extrapolation predictions are generally 
better for numerically larger, more significant 
variables, and better for the objective function 
than for the variables. In most, but not all, 
cases tested; the extrapolation via the function 
recomputation using the extrapolated variables 
(Eq. (I8c)) yielded an accuracy better than 
extrapolation via the objective function derivatives 
(Eq. (18a)). 

Particularly interesting are the extrapolation 
results for the shape parameters for three- and 
ten-bar trusses (Tables 2 and 4) since they suggest 
a potential application for decoupling the overall 
shape variables from the cross-section dimension 
variables in structural optimization. 

Still another potential use of the sensitivity 
analysis is in extrapolation of a single optimiza- 
tion with a composite objective function to the 
extremes corresponding to single objective optimiza- 
tions, as illustrated by the three-bar truss case 
with the conflicting objectives of cost and weight. 

In the foregoing examples, the extrapolation 
accuracy benefitted from the lack of slightly 
satisfied constraints with their boundaries near 
the optimum solution. If such constraints existed, 
their boundaries could have been penetrated in 
the process of extrapolation, thus introducing a 
discontinuity associated with new constraints being 
brought into the active constraint set. It is 
obviously important to be alert for such dis- 
continuities, which can be detected by Eqs. (20a) 
(20b), and (21), when extrapolating from an 
optimum solution point. 


Concluding Remarks 

Methods for determining the sensitivity deriv- 
atives of a constrained minimum solution to the 
problem parameters are discussed and the governing 
equations are derived. The equations directly 
yield the derivatives of the optimum design 
variables and of the objective function with 
respect to the parameters that are constants of 
the problem. For example, derivatives of optimal 
cross-sectional dimensions and structural mass 
of a structure can be obtained with respect to 
allowable stress, load, overall structural dimen- 
sions, etc. The derivatives or, in other words, 
the sensitivity data are obtained by solving a 
set of linear algebraical equations, thus eliminat- 
ing the need to repeat the optimization for incre- 
mented values of the parameters. While the primary 
application of the sensitivity analysis is to 
determine trends at the solution point, it has 
potential uses in optimization with multiple 
objectives, activation or deactivation of con- 
straints, and a formal decomposition of large 
optimization problems. 

The paper refers to structural optimization 
for verification of the sensitivity solutions and 
for examples of some of the many potential 


applications. The examples for a tubular column 
and a truss demonstrate determination of sensi- 
tivity with respect to load and shape parameters, 
and include extrapolation of the optimum solution 
for incremented values of the parameters. Results 
are also presented for a ten-bar truss analyzed 
by a finite-element method. Included as a test 
structure is a thin-walled beam that introduces a 
high degree of nonlinearity through inclusion of 
local buckling constraints. The results show that 
a practically significant extrapolation accuracy 
may be obtained for a reasonably broad range of 
parameter changes. The results also show that 
accuracy does not depend strongly on the degree of 
convergence of the optimum solution from which the 
sensitivity derivatives are obtained as long as 
that optimum is within practical convergence 
bounds. 

An example of optimization of a two-material 
truss with conflicting objectives of mass and cost 
points to the usefulness of the sensitivity 
analysis to predict trends and to extrapolate with 
respect to the individual objectives from the 
basis of a single optimization with a composite 
objective function. 

Finally, while the examples used in the paper 
are structural optimization problems, the equations 
for the sensitivity derivatives are entirely general 
since they are derived from the basic Lagrange 
multiplier equations or, alternatively, from 
extremum conditions for a penalty function. Con- 
sequently, the optimum sensitivity analysis applies 
to optimization problems in any discipline, and also 
to interdisciplinary systems. 


Appendix 

Details of the Numerical Examples 

This Appendix contains the detailed information 
and numerical data needed for definition of each 
numerical example. 

Tubular Column 

Numerical data for the column shown in 
Fig. la are as follows: L = 5m, P = 500 kN, 

material is steel, E = 20.6 MN/cm2, c = 0.2, 
oa = 39.2 kN/cm2, 

Design variables are t and R. The objective 
function is the material volume F = 27rRtL. Con- 
straints are (1) stress gi = a/oa - l£0; 

(2) column buckling g 2 = P/Pcr - 1 1 0; and 

(3) cylinder wall buckling g 3 = g / oq ^ x ' “ 1 1 0 
where 


a = P/A, = tt^EI/ 4L^, = cEt/R (Al) 
A = 2irRt; I = TrR^t 


From the constraint expressions in conjunction 
with Eq. (Al), one obtains formulas for the vertex 
of constraints 1 and 3: 

t = (P/2 ttcE) 1/^ R =(E^/2^a )(c/2tt)^/2 P^^^ 

^ (A2) 



Three-Bar Truss 


Box Beam 


Numerical data for the truss shown in Fig lb are 

as follows: L = 10 in., L' = /? L regardless of 
the value of angle a, P = 20 kip, material is an 
Al-alloy, oq = 20 ksi, and p = 0.1 lb/in.3. 

Design variables are and A2, with A3 = 

Ai. The objective function is material weight 


Detailed data for the box beam shown in Fig. Id 
are as follows: E= 7.38 MN/cm2, = 13,79 kN/cm^, 
Ta = 8.62 kN/cm2, v = 0.3, Ni = 

44.48 kN, N2 = 2.22 kN, N3 = 451.9 kN cm, 

Ap = 9.68 cm2, ip = 83.25 cm4, L = 50.80 cm, 
e = 0.5 and the side constraints are in cm: 

2.54 < H < 25.4, 2.54 < B < 25.4, 0,127 £ Ti < 2.54, 
0.127 < T2 < 2.54, 0.127 < T3 < 2.54. 


F = pL(2v^Ai + A^) (A3) 


and constraints are on stress in rods 1, 2, and 3 
for two loading cases, P;^ and P2, with 
Pi = P2 = P and orientation of the forces 
and ?2 not affected by changes of the angle a. 

The constraint functions are 


^u,v 




(A4) 


where 


Elimination of the Dependent Variable . Based 
on the beam cross-sectional dimensions shown in 
Fig. Id, the area A and moment of inertia I of 
the cross-section about the y-axis are: 


A = 2HT. + (Tj + - 2 T 2 ) 


(A 6 ) 


BT^(H-^)+DT 3^ + 2Tg(ll-T^-T3)(Y^(i;-T^-T^)) 




I = B 



+ BTj(H 



(A7) 


Py sin a/L'k + Pj^/2Aj^ cos a 

T ^ 


k = Aj^ 2sin^a/L' + A2/L 

= -(/2/2)P, Py = (/2/2)P 

Subscripts u and v define rod number and load 
case number, respectively. Due to the structure 
symmetry, only the constraints for stresses shown 
above need to be included. For the optimum 
locatedlO at a tangent point of a contour of the 
objective function and the function g^ = 0, one 
can use Eqs. (A3) and (A4) to derive closed form 
expressions for optimum Ai and ^2• 
given data and the particular case of a = 45°, 
these expressions are 


+ 2 


[(H - Tj - T^)]' 


12 


tIjW-T, -T3)(T3*|(I1-T, -T3) 


2 

- Yg) 

(A 8 ) 


Choosing arbitrarily the variables B and Jo as 
dependent variables, one obtains from Eq. (A6), 
(A7) and (A8) a quadratic equation for B and T2 
in terms of A, I, H, T,, T3 for which one 
solution is 


= (P/«a) ^2 = (P/a^) ^ (A5) 


B = (-a^^ - - 4a20i^)^^^)/2a2 (A9) 


Ten-Bar Truss 


T^ = (1/(2(H - T^ - T 3 )))(A - B{J^ + T 3 )) 


For the truss shown in Fig. Ic, the dimensions 
are L = 360 in., with H = L initially, one 
loading case is assumed with P = 10 ^ Ibf, and 
the material is an AI -alloy of E = 107 psi, 
aa = 25 ksi, and p = 0.1 Ibf/in.^. Design vari- 
ables are ten rod cross-sections; the minimum 
limit on A is Amin = 0-1 in. 2; and constraints 
are imposed on stress in the j-th rod: 

9j ^ bj|/^a ■ 1 objective function is 

tne structural weight. 


where 


a 


0 


121 

[H - (Tj + T^)]^ 


- A 


(AlO) 
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A 


+ T 3 ) -2H(Tj + + iZHTjT^ 

“1 " [H - (Tj + T^)]^ 

3H^(Tj - Tj)^ 

“2 " A[H - (Tj + 

The other possible solution (having a positive 
sign of the square root term in Eq. (A9) leads to 
another local optimum design point. It was found 
experimentally that in this case the Eq. (A9) 
solution provides a better design (lower objective 
function value) than the other solution. Therefore, 
only the Eq. (A9) solution was used. 


at 1 

+ N3(|| - ivj 
'^bl I 


at 2 


:!!3 , 

‘^b2 I •^G ■ A 


at 4 

-{NgL - N3) (II - y^) 

°b4 " I A 


Constraint Definitions . Two groups of con- at 5 

straints are defined: one for geometry and one for 

strength. The geometry constraints are as follows: + (N^L - ''*1 

^ T " I X 

1. Upper and lower limits 


(A14) 


g = 1 - x./x.^ 1 0 and g = - 1 < 0 


Shearing stress at point 3 is 


(All) T = n^Q/(2lJ^) 


(A15) 


respectively, where xi's correspond to dimensions 
B, H, T^, T2, T3. 

2. Limits assuring that the box cross-section 
remains hollow 

H - T - T3 

g = 1 - 3(T,, . T 3 ,) ^ ° 
g " ^ ■ 3(272^) - ° 


where T^ , T2 l> Tjl are thickness minimum 
gages, and the coefficient 3 is a judicious 
factor. 

3. A real number solution requirement for 
Eq. (A9): 

g = -{(<^1^ “ - e) £ 0 (A13) 


where Q = ^2(H - yc - Tj^)^ + bT^j^(H - Ti/2 - y«). 
Each of the above stress values is constrained^to 
an allowable value by 


g ' allowable stress ‘ ^ 1 ° (*16) 


Critical local buckling stresses are (Ref. 14): 
TT^k E 

a.„ = 5— (T,/B) at points 1 and 4, 

12(1 - v^) - 


ir^k E 2 

a = ^ (To/B) at points 2 and 5 with 

12(1 - v^) kc = 5.5 (Ref, 15). 


These critical stresses are combined with the 
stresses from Eq. (A14) into stability constraints 


where e is a small positive constant. 

The strength constraints are stress and local 
buckling constraints evaluated by engineering beam 
bending theory formulas and approximate closed 
form solutions for local buckling of a thin-walled 
beam. These constraints are computed at nine 
points strategically distributed over both end 
cross-section contours as shown in Fig. Id. The 
constraint formulas are shown below. Normal 
stresses due to bending and axial force are at 
points 1, 2, 4, 5: 


g = (compressive stress)/(critical stress) 

- 1 < 0 (A17) 


The stability constraint for the vertical web under 
the combined action of normal and shearing stresses 
is computed at points 6, 7, 8, and 9 according 
to an interaction formula: 


12 




i 6, 7)8)9, 

(A18) 


where 


^^Schmit, L. A.: Basis for Assessing the State- 

of-the-Art Structural Design Applications of 
Mathematical Programing Techniques. A6ARD0GRAPH 
No. 149, Chapter 2, 1971. 

^^Schmit, L. A.; and Ramanathan, R. K. : A Multi- 

level Approach to Minimum Weight Design Including ,i 
Buckling Constraints. AIAA J., Vol . 16, No. 2, 

Feb. 1978, pp. 97-104. 


= 

12(1 - v^) 


kcjdg/B)^ 


j = 1.2.3, 


12 

Storaasli, 0. 0.; and Sobieszczanski , J.: On 

the Accuracy of the Taylor Approximation for 
Structure Resizing. AIAA J., Vol. 12, No. 2, 
Feb. 1974, pp. 231-233. 


J 


with k^i = 33, kc2 = A and kq 3 = 7.5 (Ref. 15, 
C5.15, C5.2, and C5.ll, respectively); is 

normal stress due to bending moment only given by 
the first term in each of the equations (Al4), 

02 is normal stress due to axial force, 

02 = -Ni/A, and shearing stress x is defined by 
Eq. (A15). 
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Table 1 Optima and sensitivity derivatives for tubular column and three~har truss (Figs, la and lb) 


KEY: 1. from Eq. 

maximization 
Aa = 0.01% 

(4); 2. from direct differentiation; 3. from Eq. (15); 4 and 5. case 4, subcase 2, 
and minimization of dF/dp, respectively; 6. central finite difference for 
in addition to analytical differentiation. 

Variable 


Optimal value Key Sensitivity derivatives 

A. Tubular column 


d/d? 





1 

1.390 7 

X 10“' 


t, 

cm 

0.139 


cm/N 




2 

1.390 





1 

1.459 . 


R. 

cm 

14.59 


X 10"° 

cm/N 




2 

1.459 


F. 

rJ 

cm 

6371.18 

1 

2.028 

X 10"'^ 

cm^/N 




2 

2.028 




B. Three-bar truss, 

a = 45° 






3/SP 

3/3a 




1 

3.940 

-0.88345 

O 


2 

3.940 . 

xlO'^ 

-0.8849 

in^ 

0.7887 

3 

3.940 




4 

0.0 in^/lb 

2 

in /rad 



5 

4.662 




1 

2.049 

0.97571 



2 

2.049 

X 10'^ 

0.9793 

A 2 , in 

0.4093 

3 

2.051 




4 

13.231 in^/lb 

2 

in /rad 



5 

0.00 




1 

13.190 

-1.523 



2 

13.190 (. 

X 10’® 

-1.524 

F, lb 

2.64 

3 

13.190 




4 

13.231 in^/lb 

lb/ rad 



5 

13.186 



14 




Table 1 Concluded 


Variable 

Optimal value 

Key 

Sensitivity derivatives 


C. Three-bar truss, a = 60° 


8/ 8a 


p 


1 

-0.52044 

2 

A, , in 

0.6023 



in /rad 

i 


6 

-0.52044 


2 


1 

0.04373 

2 

A«, in 

0.5536 



in /rad 

c 


6 

0.04373 




1 

-1.4283 


F, lb 

2.257 

6 

-1.4283 

lb/ rad 



Table 2 Comparison of extrapolation and optimization for three-bar truss 



Aa 

Weight 

Al 



% 

lb 

in2 

in2 

Configuration with a = 45° 

h 

0 

2.629 

0.7911 

0.3919 



2.689* 

0.8253 

0.3536 

2 

-5 

2.690** 

0.8198 

0.3712 



2.690*** 

0.8256 

0.3547 



2.749 

0.8605 

0.3152 

3 

-10 

2.755 

0.8701 

0,2934 



2.754 

0.8619 

0.3166 



2.869 

0.9299 

0.2386 

4 

-20 

2.899 

0.9514 

0.2082 



2.899 

0.9574 

0.1912 

^5 


2.231 

0.5598 

0.6473 

+33.3 

2.257 

0.6023 

0.5536 



2.257 

0.6050 

0.5460 


Configuration with a = 60° 


^6 0 

2.257 

0.6023 

0.5536 

M 

2.631 

0.7385 

0.5422 

^7 -25 

2.629 

0.7911 

0.3919 


2.631’^ 

— 



*first line: extrapolation; **second line: reoptimization from initial point; ***third line: reoptimiza- 

tion from optimum point 


#) 

'NOTE: 1. Rows 5 and 6 correspond to the same configuration with a = 60°. 

2. Rows 1 and 7 correspond to the same configuration with a = 45°. 

3. Optimum values in row 1 are from numerical optimization hence they differ slightly from 

^Obtained from Eq. (18c) Table IB. 
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Table 3 Optimum solution and its sensitivity derivatives with respect to parameter H 
for ten^bar truss (Fig, Ic) 


Rod no. 

Cross-section area 

3(cross-section 

area)/3H 

1 

7.9606 (in^) 

-0.20672061 

10"^ 

(in^/in) 

2 

0.1 

0.0 

10"^ 

II 

3 

8.0676 

-0.20095106 

II 

4 

3.9521 

-0.9871375 

10'^ 

II 

5 

0.1 

0.0 


II 

6 

0.1 

0.0 


II 

7 

5.7505 

-0.71620975 

10"^ 

II 

8 

5.5863 

-0.75472761 

10'^ 

II 

9 

5.5699 

-0.69817317 

10’^ 

II 

10 

0.1 

0.0 


II 

Weight 

1595.92 lb 

3(weight)/3H 

= -1.7047630 Ib/in 



Table 4 Comparison of extrapolation and reoptimization for variations 
of parameter H in ten-bar truss 


Increments of H, % 


0 


5 


10 20 


Rod no. 


Cross-section areas, 


in 


1 


7.961 


7.589* 7.216 6.472 

7.584** 7.224 6.635 


O 

0.1 

0.1 

0.1 

0.1 


L 

0.1 

0.1 

0.1 


*3 

8.068 

7.706 

7.344 

6.621 


O 

7.700 

7.350 

6.736 


/I 

3.952 

3.774 

3.597 

3.241 



3.756 

3.589 

3.280 


c 

0.1 

0.1 

0.1 

0.1 


3 

0.1 

0.1 

0.1 



6 


0.1 


7 5.751 


8 5.586 


0.1 

0.1 


5.622 

5.626 


5.450 

5.437 


9 5.570 


10 0.1 

Weight, lb 1595.92 


5.444 

5.439 


0.1 

0.1 

1565.23 

1563.33 


"*f1rst line: ^trapolation using Eqs. (18a) and (18b); **second line: 


0.1 

0.1 


5.493 

5.497 


5.315 

5.338 


5.319 

5.324 


0.1 

0.1 

1534.55 

1535.50 


reoptimization 


0.1 

0.1 


5.235 

5.289 


5.043 

5.144 


5.067 

5.121 


0.1 

0.1 

1473.18 

1491.94 
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Tabic 5 Optimum solution and derivatives with respect to parameters N3 (end bending moment) 
and Ip (moment of inertia corresponding to 1I3) for box beam (Fig. Id) 


Variabl e 
(Fig. Id) 

Optimal value, cm 

Derivative 9/DN3, cm/ficm 

Derivative 9/9lp, cni/cni^ 

H 

6.807 

-1.0396 • 10‘® 

4.469 • 10'^ 


0.3246 

1.3756 ■ 10'® 

2.460 • 10'^ 

^3 

0.5415 

-6.0940 • 10*^ 

2.638 • 10'^ 

B* 

9.425 

-- 

— 

T * 
* 0 

0.1275 

-- 

-- 



1/Ncm 

1/cm^ 

Objective F 

0.2735 

4.6030 • 10'® 

-1.1848 • 10"^ 


^Dependent variables 


Table 6 Comparison of extrapolation and reoptimization for variations 
of parameters N3 and Ip in box beam 


Perturbed designs 


Increment of N3, % Increment of Ip, % 


Variable 

Baseline optimal design 

5 

10 

20 

5 

10 

20 

H, cm 

6.807 

6.784* 

6.783** 

6.760 

6.770 

6.713 

6.715 

6.993 

6.987 

7.179 

7.170 

7.551 

7.534 

Tj, cm 

0.3246 

0.3249 

0.3246 

0.3254 

0.3254 

0.3259 

0.3279 

0.3256 

0.3249 

0.3266 

0.3264 

0.3287 

0,3299 

T^, cm 

0.5415 

0.5276 

0.5268 

0.5138 

0.5199 

0.4864 

0.4867 

0.5525 

0.5494 

0.5634 

0.5611 

0.5832 

0,5984 

B, cm 

9.425 

9.579 

9.590 

9.736 

9.663 

10.08 

10.04 

9.240 

9.288 

9.046 

9.096 

8.646 

8.672 

T^, cm 

0.1275 

0.1275 

0.1275 

0.1273 

0.1273 

0.1262 

0.1273 

0.1280 

0.1273 

0.1293 

0.1278 

0.1339 

0.1232 

F'’ 

0.2735 

0.3775 

0.3890 

m 

0.6896 

0.8912 

0.2242 

0.2279 

0.1749 

0.1906 


Ft 

— 

0.3891 

0.5279 

0.8864 

0.2283 

0.1922 

0.1373 


*first line: extrapolation, by Eq. (18a)t, by Eq. (I8c)i; 

**second line: reoptimization 
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Table 7 Use of sensitivity and extrapolation for three-bar truss 
optimization for mass and cost 



Objective function* 

in'" 

"^2 

in 

Optimum for a^ = a 2 = 1 

1 

F, = 4.150 

^ 0.4910 

= 3.6963** 

0.1430 

Sensitivity derivatives 

2 

4.1422*** -0.035805 

0.11371 

Sensitivity derivatives 9/3a^ 

3 

3.7011*** 0.032997 

-0.10479 

Extrapolation and reoptimization for mass only a^ =1 , a 2 = 0 


4.0547+ 0.4577 

0.2526 

4 

4.0457+ 0.4308 

0.3812 

Extrapolation and reoptimization for cost only aj^ = 0, a 2 = 1 


3.5980t 0.5265 

0.03411 

5 

3.6240+ 0.5455 

0.00001 



*)objective function is F = ajFi + being the mass and F 2 the cost 

**)quantity 3 F 2 . instead of F 2 alone, is referred to consistently in the table 

***)total derivative, dF/da-j 

■^first line: extrapolation using Eq. (18c) 

^second line: reoptimization 
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Table 8 Influence of degree of convergence of optimum solutions 
on the sensitivity derivatives fo r three-bar tru ss 


Tolerance C 

0.0001 

0.001 

0.01 

0.1 

liuiiiber of iterations 

18 

7 

5 

4 


Optimal 

solutions 



Ai, in^ 

0.7944 

0.S01S7 

0.78238 

0.79026 

2 

A2» in 

0.38233 

0.36502 

0.4211 

0.39907 

Weight, lb 

2.62927 

2.63306 

2.63401 

2.63427 

Sensitivity derivatives 

2 

aAj^/Ba, in /rad 

0.8993 

2.9 

0.9141 

4.6* 

0.8737 

0.8394 

1.8 

8A2/3a, in^/rad 

-1.0243 

7.8 

-1.0623 

11.8 

-0.9503 

-0.9945 

4.7 

Weight, 3W/8a, Ib/rad 

1.5188 

-0.01 

1.5227 

0.01 

1.5210 

1.5210 

0.0 


*Relative difference = 100% REFEREfJCE being the corresponding value from the 

column for C = 0.01 
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T.ihlo 9 

Influence of degree of convergence 
on the sensitivity derivatives for 

of optimum solutions 
Len-bar truss 



luhnMnce C 

o.oo: 

0.006 

0.01 


lUiiibet' of i Lora lions 


26 

21 



optimal solutions 




A|**, w/ 

7.9606 

7.9152 

3.1914 


Aq, in 

5.5699 

5. boll 

5.5847 


Hoiijht, 11) 

1595.92 

1595.72 

1608.23 


Sensitivity derivatives 

2 

in /in 

-0.020672 

0.60* 

-0.020549 

-0.029937 

45.7 

2 

aAg/;)H. in /in 

-0.00698 

4.2 

-0.00670 

-0.006898 

3.0 

Weight, aW/3H. Ib/in 

-2.9273 

0.10 

-2.9253 

-3.61609 

23.61 


*See footnote in Table 8, column for C = 0.006 is REFERENCE column 
♦^Selected cross-sections only to show largest and smallest effect of C on 3 / 3 M 
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Table 10 

Influence of degree of convergence of optimum 
sensitivity derivatives for box beam 

on the 


■ ■ ' 

Tolerance C 

0.001 

0.005 

0.025 


Number of iterations 

25 

19 

13 


Optimal solutions 

H, cm 

6.806 

6.803 

6.843 


cm 

0.3246 

0.3241 

0.3287 


cm 

0.5410 

0.5377 

0.5677 



B, cm 9.431 9.468 9.111 


2 ^> cm 

0.1275 

0.1278 

0.1270 


Objective F 

0.2734 

0.2736 

0.2759 


Sensitivity derivatives 8 / 3 N 3 

3 H/ 3 N 3 , cm/Ncm 

-1.037 • 10'® 

5.2 

-9.853 • 10"^ 

-1.458 • 10'® 

47.9 

3 Tj^/ 3 N 3 , cm/Ncm 

1.379 • 10’® 

-9.0 

1.515 • 10'® 

-1.761 • 10 '^° 

101.0 

3 T 3 /SN 3 , cm/Ncm 

-6.077 • 10"^ 

5.3 

-5.769 • 10'^ 

-8.630 • 10~^ 

49.6 

3 F/ 3 N 3 , l/Ncm 

4.602 • 10'^ 

0.0 

4.604 • 10'® 

4.603 • 10'^ 

0.0 

Sensitivity derivatives 3/3Ip 

3H/3Ip. cm/cm4 

4.466 • 10'^ 

0.4 

4.450 • 10"^ 

4.619 • 10'^ 

3.8 

3Ti/3lp. cm/cm4 

2.453 • 10'^ 

2.3 

2.399 • 10'^ 

2.977 • 10'^ 

24.1 

3T3/3Ip. cm/cm"^ 

2.632 • 10"^ 

4.2 

2.526 • 10'^ 

3.508 • 10"^ 

38.9 

3F/3Ip. l/cm4 

-11.85 • 10“^ 

0.0 

-11.85 • 10'^ 

-11.84 • 10'^ 

0.0 


*See footnote in Table 8 ; 

reference column is column 

for C = 0.005 
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Fig. 1 Numerical examples: (a) tubular column, 
(b) three-bar truss, (c) ten-bar truss, (d) box 
beam. Numerical data are given in Appendix. 


^ n ^ — A— FVTRAPni ATIOM 



0 5 10 15 20 


AH, % 

Fig. 2 Ten-bar truss: objective function and one 

cross-section as functions of parameter H 



0 5 10 15 20 

Alp. % 

Fig. 3 Box b/^am: Objective function and width as 

functions of parameter Ip 
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